The picture on the right shows sample forces calculated in Framsticks physical simulator:
|
![]() |
Simple excitation. The state goes up when the input is positive and falls down when the input reaches zero. Note that in this example the neuron's state can fall below zero due to its inertia. |
![]() |
Short but strong impulse gives similar results to weak and long one. |
![]() |
In this example a strong signal causes saturation of the neuron (its state goes very high). Later signal changes do not influence the output. |
![]() |
Force=0.1, Inertia=0: Slow state change. Note the instant reaction after the input signal pulse when inertia is disabled. |
![]() |
Force=0.1, Inertia=0.8: With inertia enabled, neuron's state raises above input pulse amplitude, and then drops below zero. Final state is achieved after several oscillations. |
![]() |
Force=1, Inertia=0: Maximum force coefficient results in an instant input to output propagation. |
![]() |
Sigmoid coefficient changes the output function.
The following formula is used:
Output = 2/(1+exp(Sigmoid * State))-1
Examples:
Sigmoid=2.0 (default) |
![]() |
Sigmoid=10.0 (high values of sigmoid produce nearly a threshold function) |
![]() |
Sigmoid=0.5 (low value gives nearly linear output function) |
![]() |